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An Infrared Imaging Tracker for Point and 
Near Point Source Targets 


_ Authors: Zhang, Xiaolin and Shu, Yuwen 
(Huabei Photoelectric Technology Institute, Box 8511, Beijing 100015) 


Abstract: This article introduces an infrared tracker used for point and near point source 
targets, provides a block diagram of tracker composition, and describes in detail a three-frame 
correlation multiple differentiation algorithm for target detection. Hardware results show that the 
design of this tracker is correct. 


Key Words: Infrared imaging tracker for point and near point source targets, three-frame 
correlation multiple differentiation algorithm 


1. Preface 


Multiple-mode tracking is necessary for imaging tracking technology, because no single 
tracking mode can adapt to complex, changing target and background conditions. Detection and 
acquisition of targets is generally carried out at long distances, and this exactly conforms to point 
and near point source conditions. Also, because the signal-to-noise ratio is very small at long 
distances, especially for small, slow-moving targets, suppression of background clutter is one of 
the issues that must be considered for this system. Even in situations where background clutter 
has been effectively suppressed, there is still a false alarm probability that cannot be ignored. 
Thus, further elimination of false targets in order to effectively acquire real targets is another 
critical signal-processing technology. This tracker employs three-frame correlation multiple 
differentiation algorithm technology whose purpose is to eliminate leftover false targets and, 
according to predetermined requirements, choose which tracking targets take precedence. 


2. System Configuration 


Figure 1 gives a full description of the configuration of the system. After video signals 
from the thermal imaging system pass through A/D conversion, digitized wave filtering 








Suppresses background clutter. Acquisition and tracking states use different threshold partition 
algorithms, and can perform threshold coefficient selection according to a priori knowledge of 
different targets’ backgrounds or on-the-spot training. One can see from the figure that 
Switchover of acquisition and tracking states is executed by corresponding commands. 

Differentiation algorithms are used in both acquisition and tracking states. In the latter, 
they are used to determine whether the target has been lost, and in the former, they are used to 
- differentiate and select which targets to track. The differentiation algorithm used in acquisition 
will be discussed in detail below. 


The normal tracking state is three-point quadratic prediction tracking. When target loss 
has been determined — for example, if the target is temporarily hidden from view — three-point 
linear memory tracking is implemented. After n seconds of delay, presently set at three seconds, 
if still in a target loss state, the system will switch over to the acquisition state and again carry 
out the detection and acquisition process. 


In the tracking state, position error signals used for open-loop tracking simulation are 
output. At the same time, angle error signals can be output to the feeder system to carry out 
closed-loop tracking. 

3. Three-frame Correlation Multiple Differentiation Algorithm 


3.1 Basic Algorithm 


The following basic operations were carried out according to partitioned data (Xi, Yi, Si), 
where Si is the brightness of the ith pixel, | 


1) Potential target grouping: Adjacent pixels with position differences of <2 pixels are 


defined as one group (one of the potential targets), and the pixel number of the /th group is set 
as ™),. : 
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2) Mean value of potential target brightness: 
Ss a (2S3..)/ms. (1) 


3) Potential target centroid: 


a 

X; = CL Xs.,9/a3> (2) 
ie : | 
& —_ 

Ys © (2 Ys.0)/m3. (3) 
i=! 


3.2 Correlation Operations 


Adjacent three-frame (or, these three frames as an interval of n frames between every two 
adjacent frames, in order to more easily distinguish the target’s state of motion) data are used to 
carry out the following correlation operations: 


1) Pixel data correlation: 
| my (K-2)-e5(K-1) | and | ms (K-1)~a5(K) 1< 2. (4) 
2) Brightness correlation (rough): 
The goal of the above correlation operations is to first eliminate abiicencneiaans false targets. 


3) Relative rest or parallelism to the axis of sight is correlated to the stability of the target 


in motion: 


| Xs (K-2)-Xs(K-1) | and | Xs(K-1)-X2(K) | < 2pixel.- | 
| ¥g(K-2)-Ys(K-1) | and | ¥s(-1)-¥s(K) | < Apixel. | 


This correlation operation helps eliminate random interference. 
4) Correlation of moving target: 


Definition: 





X, (B-2)-X, (0-1) s AXs.1 (8) 
Xz(K-1)-X%3(K) = AXs.: 


Similarly, a definition like that above can be made for component Y. 


Range of speed of target motion is limited to: 


| AXs.1 | and} AXs.a | ( 26 pixel (7) 
aad - 
| AYs.3 | and] AYs.21 ( 20 pixel (8) 
Equidirectional motion determination: 
AXs.1 and AXs. BSHE ( 
aad © 9) 
AY3.: and AYs.2 FSH (10) 


Key: (1). Symbols are the same 


Orbit correlation determination: Where conditions (7)—(10) are fulfilled, we further 


require 


t AXs.,]-] AXs.2] < 2 pixel (11) 


and 
1 AYs.11-1 ASYs.2!1 < 2 pixel (12) 


The above algorithms can effectively reduce the amount of operations and differentiate near- 
uniform motion targets. This conforms to long-distance detection and acquisition conditions. 


Determination of fastest and slowest motion speed of moving target: Where conditions 
(7)—(12) are fulfilled, let 
C] AXs.a1 +1 AXs.a/) 72 * Vx.2 


C{ AYs.: +f OY3.3 | »/ 2 = Vv. 


V3 = Vx.a + Veg (13) 


to derive 
My = Max (V3) 
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According to the above criteria, it is possible to program the priority of targets for 
acquisition. For example, it is possible-to first acquire the target with the highest speed of 
motion, or a relatively motionless target from among multiple targets. If there is more than one 
relatively motionless target, it is possible to program selection of the smallest target or the one 
with the greatest brightness for tracking. 


4. Discussion 


Where signal-to-noise ratio is very low, even if background clutter suppression and 
multiple-frame correlation multiple differentiation technology are applied, false targets may still 
exist. In addition to further improving wave filtering technology and hardware technology, 
artificial interference technology can also be employed. Consideration was given to this 
technology during the design of this tracker, and a high-resolution touch-screen display device 
would be an ideal choice. A more fundamental development direction, however, is multiple- 
sensor fusion of target-priority artificial intelligence decision-making technology with system — 
fusion technology. 


5. Conclusions 


This article introduces a tracker that uses specially designated background clutter 
suppression wave filter technology and three-frame correlation multiple differentiation technology 
This tracker has already been realized in hardware form. The performance of the hardware 
tracker and ring opening tracking results show that the tracker’s design and relevant algorithms 
are correct. Following further perfection and improvements to reliability, it can be applied to 
corresponding engineering systems. 


Note: During the formulation of this project, Liu Zhili, Yan Jun, Hao Wenhui, and other 
comrades participated in discussions. 
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Key: (1). Figure 1. Point and near point source target infrared imaging tracker configuration 
block diagram. (2). Infrared imaging system. (3). Feeder system. (4). AD conversion. (5). 
Position and pitch error angle calculation. (6). Digital wave filter (background suppression). (7). 
Switchover between acquisition and tracking states. (8). Three-field quadratic prediction tracking. 
| (9). Three-field linear memory tracking. (10). Target centroid coordinate error. (11). Artificial 
adjustment of threshold parameters. (12). Adaptive partition with local statistics during 
acquisition. (13). Adaptive partition with maximum-value statistics inside fixed wave door. (14). 
Three-field determination of whether or not target is lost. (15). Target acquisition signal. (16). 
Three-frame correlation multiple differentiation. (17). Wave door generator. (18). n-second 
delay. (19). Target acquisition centroid. (20). Reacquisition command. 


